54 ] Zhang's, [
60 ] Mettler's, [
56 ] and our experimental works. Reproduced with permission. [
54 ] Copyright 2024, Wiley. Reproduced with permission. [
60 ] Copyright 2018, American Institute of Physics. b) Machine vision framework consisting of training, object detection, and data processing modules. High‐resolution images are acquired using high‐speed optical imaging to generate a large input image dataset for training the Deformable DETR. After training, raw images are delivered into the Deformable DETR module where the microfluidic droplets in the raw images can be identified. The detected data then, undergoes data processing module where useful parameters of the detected droplets can be obtained. " width="100%" height="100%">
Journal: Advanced Science
Article Title: A Machine Vision Perspective on Droplet‐Based Microfluidics
doi: 10.1002/advs.202413146
Figure Lengend Snippet: Conception of the machine vision on Microfluidic droplets. a) An overview of this study. The trained machine vision can identify both single and DE droplets, as well as other core–shell structures. The original images here for identification demonstration come from Liang's, [ 54 ] Zhang's, [ 60 ] Mettler's, [ 56 ] and our experimental works. Reproduced with permission. [ 54 ] Copyright 2024, Wiley. Reproduced with permission. [ 60 ] Copyright 2018, American Institute of Physics. b) Machine vision framework consisting of training, object detection, and data processing modules. High‐resolution images are acquired using high‐speed optical imaging to generate a large input image dataset for training the Deformable DETR. After training, raw images are delivered into the Deformable DETR module where the microfluidic droplets in the raw images can be identified. The detected data then, undergoes data processing module where useful parameters of the detected droplets can be obtained.
Article Snippet: Note (Supporting Information) details our five established microfluidic systems for generating multiple microfluidic droplets including normal oil–water–oil (o–w–o) DEs, nanoberries [ ] encapsulated liposomal DEs, SDs, phase change material (PCM) encapsulated DEs, cell encapsulated droplets.
Techniques: Optical Imaging
Journal: Advanced Science
Article Title: A Machine Vision Perspective on Droplet‐Based Microfluidics
doi: 10.1002/advs.202413146
Figure Lengend Snippet: Schematics of manually labeled and machine identified microfluidic droplets and evaluation system. a) Typical manually labeled microfluidic droplets for training and evaluation. Microfluidic droplet images for various scenarios such as SDs and DE droplets (single inner droplet and multiple inner droplets) were adopted for manual annotation with rectangular manually labeled boxes for wide applications of microfluidic droplet research and industry. b) Rectangular schematic manually labeled, and machine identified boxes with coordinate information. c) Intersection area (filled by orange) and d) Union area (filled by yellow) between the manually labeled and machine identified boxes. e) examples of poor, good, and excellent identification with IoU values.
Article Snippet: Note (Supporting Information) details our five established microfluidic systems for generating multiple microfluidic droplets including normal oil–water–oil (o–w–o) DEs, nanoberries [ ] encapsulated liposomal DEs, SDs, phase change material (PCM) encapsulated DEs, cell encapsulated droplets.
Techniques: Labeling
56 ] Lashkaripour's, [
41 ] Kim's, [
57 ] Fu's, [
58 ] Hughes's, [
59 ] Zhang's, [
60 ] Foster's, [
61 ] Zarzar's, [
62 ] and Zhang's [
63 ] works, respectively. Reproduced with permission. [
41 ] Copyright 2024, Springer Nature. Reproduced with permission. [
58 ] Copyright 2014, Elsevier. Reproduced with permission. [
59 ] Copyright 2013, Elsevier. Reproduced with permission. [
60 ] Copyright 2018, American Institute of Physics. Reproduced with permission. [
61 ] Copyright 2010, Elsevier. Reproduced with permission. [
62 ] Copyright 2017, The National Academy of Sciences of The United States of America. Reproduced with permission. [
63 ] Copyright 2019, The National Academy of Sciences USA. The scale bars in (a, b, c, d, and e) represent 100, 50, 100, 200, and 100 µm, respectively. The white and black scale bars in (i) represent 100 µm. The deep blue MIBs denote the outer droplets of DEs, and the black ones are inner droplets of DEs. The red ones represent the SDs. " width="100%" height="100%">
Journal: Advanced Science
Article Title: A Machine Vision Perspective on Droplet‐Based Microfluidics
doi: 10.1002/advs.202413146
Figure Lengend Snippet: Single‐image‐based Identification of microfluidic droplets and analysis from multiple scenarios. a–i) Machine identification of the DE droplets with inner cores and statistical analyses based on the identification results. The DE droplet images in (a, b, c, d, e, f, g, h, and i) are originally from Metter's, [ 56 ] Lashkaripour's, [ 41 ] Kim's, [ 57 ] Fu's, [ 58 ] Hughes's, [ 59 ] Zhang's, [ 60 ] Foster's, [ 61 ] Zarzar's, [ 62 ] and Zhang's [ 63 ] works, respectively. Reproduced with permission. [ 41 ] Copyright 2024, Springer Nature. Reproduced with permission. [ 58 ] Copyright 2014, Elsevier. Reproduced with permission. [ 59 ] Copyright 2013, Elsevier. Reproduced with permission. [ 60 ] Copyright 2018, American Institute of Physics. Reproduced with permission. [ 61 ] Copyright 2010, Elsevier. Reproduced with permission. [ 62 ] Copyright 2017, The National Academy of Sciences of The United States of America. Reproduced with permission. [ 63 ] Copyright 2019, The National Academy of Sciences USA. The scale bars in (a, b, c, d, and e) represent 100, 50, 100, 200, and 100 µm, respectively. The white and black scale bars in (i) represent 100 µm. The deep blue MIBs denote the outer droplets of DEs, and the black ones are inner droplets of DEs. The red ones represent the SDs.
Article Snippet: Note (Supporting Information) details our five established microfluidic systems for generating multiple microfluidic droplets including normal oil–water–oil (o–w–o) DEs, nanoberries [ ] encapsulated liposomal DEs, SDs, phase change material (PCM) encapsulated DEs, cell encapsulated droplets.
Techniques: